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Abstract 


For  linear  programming,  a  primal-dual  interior-point  algorithm  was  recently 
constructed  by  Zhang  and  Tapia  that  achieves  both  polynomial  complexity  and 
Q-superlinear  convergence  (Q-quadratic  in  the  nondegenerate  case).  In  this  pa¬ 
per,  we  extend  their  results  to  quadratic  programming  and  linear  complementarity 
problems. 


1  Introduction 


Primal-dual  interior-point  algorithms,  originally  introduced  by  Megiddo  [10]  in  1986  for 
linear  programming,  have  a  close  connection  to  Newton’s  method.  Exploiting  this  con¬ 
nection,  Zhang,  Tapia  and  Dennis  [16]  established  sufficient  conditions  for  primal-dual 
algorithms  to  achieve  superlinear  convergence  for  linear  programming  (LP).  Zhang,  Tapia 
and  Potra  [17]  extended  these  results  to  quadratic  programming  (QP)  and  linear  com¬ 
plementarity  problems  (LCP).  Recently,  Zhang  and  Tapia  [18]  constructed  a  primal-dual 
algorithm  that  exhibits  both  polynomial  complexity  and  Q-superlinear  convergence  (Q- 
quadratic  in  the  nondegenerate  case).  More  recently,  Kojima,  Kurita  and  Mizuno  [2] 
proposed  rules  for  choosing  parameters  in  primal-dual  algorithms,  and  showed  that  for 
LCP  one  set  of  rules  leads  to  both  global  convergence  (but  not  necessarily  polynomial) 
and  superlinear  convergence. 

In  this  paper,  we  extend  the  Zhang- Tapia  algorithm  [18]  from  LP  to  QP  and  LCP, 
and  prove  the  same  theoretical  properties,  i.e.,  polynomial  complexity  and  superlinear 
convergence,  for  the  extended  algorithm. 

We  take  a  unified  approach  towards  linear  programming  quadratic  programming  and 
linear  complementarity  problems.  The  basis  of  this  unified  approach  is  the  following 
nonlinear  system  with  nonnegativity  restrictions  on  the  variables 
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where  x,  y,h,e  £  Rn,  M,  N  £  R"Xn,  X  =  diag(x ),  Y  =  diag(y)  and  e  has  all  components 
equal  to  one. 

Problem  (1.1)  is  sufficiently  general  to  include  linear  complementarity  problems, 
quadratic  programming  problems  and  linear  programming  problems.  To  begin  with, 
observe  that  if  iV  =  —  I,  then  this  problem  is  the  standard  linear  complementarity  prob¬ 
lem.  Consider  the  following  equality  constrained  quadratic  programming  problem 


minimize  cTx  +  \xTQx 

subject  to  Ax  =  b,  (1.2) 

x  >  0, 


where  c,  x  £  Rn,  b  £  Rm,  A  £  R mXn(m  <  n)  and  has  full  row  rank,  and  Q  £  RnXn.  If  Q 
is  symmetric  and  positive  semi-definite  on  the  null  space  of  A)  then  QP  (1.2)  is  a  convex 
program  and  the  first  order  optimality  conditions  are  both  necessary  and  sufficient  for 
optimality.  The  first-order  conditions  for  (1.2)  can  be  transformed  into  the  form  of  (1.1), 
as  was  shown  in  [17],  with 


A 

0 

6  j 

M  = 

-BQ 

,  N  = 

B 

and  h  = 

1  BC  ! 

(1.3) 


where  B  £  R(n— m)xn 

is  any  matrix  such  that  the  columns  of  BT  form  a  basis  for  the 
null  space  of  A.  When  Q  =  0,  the  quadratic  programming  problem  (1.2)  reduces  to  the 
standard  form  linear  programming  problem. 

A  direct  calculation  shows  that 


F'(x,y) 


M  N 
Y  X 


(1.4) 


The  feasibility  set  of  problem  (1.1)  is: 


f  =  {(®,  y):  x,y  £  Rn,  Mx  +  Ny  =  h,  (x,  y)  >  0}. 


Moreover,  a  feasible  pair  (x,  y)  £  T  is  said  to  be  strictly  feasible  if  it  is  positive. 
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Throughout  this  paper,  whenever  we  consider  LCP,  we  assume  that  the  matrix  M 
is  positive  semi-definite;  and  whenever  we  consider  QP,  we  assume  that  the  matrix  Q  is 
symmetric  and  positive  semi-definite  on  the  null  space  of  A.  Also,  we  will  assume  that  a 
strictly  feasible  point  exists. 

Subscripts  will  be  used  to  distinguish  values  of  quantities  at  a  particular  iteration  and 
superscripts  will  indicate  components  of  vectors.  We  also  use  the  notation: 

min(v)  =  min(u*)  =  min  v*  and  max(r)  =  max(r')  =  max  v' 

for  a  vector  v  €  Rn.  The  symbol  ||  •  ||  denotes  the  £2  norm  unless  otherwise  stated. 

The  paper  is  organized  as  follows.  In  Section  2,  we  describe  the  basic  interior-point  al¬ 
gorithm  for  our  general  model  (1.1).  In  Sections  3,  we  specify  our  choice  of  the  step-length 
and  the  centering  parameter.  Polynomiality  and  superlinear  convergence  are  established 
in  Sections  4  and  5,  respectively.  Concluding  remarks  are  given  in  Section  6. 


2  Algorithm 


The  basic  algorithm  we  will  study  is  the  following. 

Algorithm  1 

Given  a  strictly  feasible  pair  (xq,  yo)-  For  k  =  0, 1, 2, . . .,  do 


A," 


Step  1  Compute  the  Newton  step 

( 

K  A  y? 

and  the  centering  step 


= -[F'(xk,yk)\  1F(xk,yk) 


( Ml) 

=  X-xlyk[F'{xk,yk)}-'  \ 

J 

V e  / 
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Step  2  Choose  ak  E  (0,1)  and  form  the  combined  step 

(  Axk  \  (  Ax?  \  (  Ax?  \ 

=  +<?k  • 

\  Ayk  )  \  Ay?  /  \  Ay?  ) 

Step  3  Choose  ak  =  rkak)  where  rk  E  (0, 1)  and 

A  _ _ -1 _ 

ak  min^^"1  Axfc,  Yf1  Ayk) 

Step  4  Compute  the  new  iterate 


Notice  that  since  ( x0,yo )  is  strictly  feasible,  all  the  subsequent  iterates  {(xk,yk)}  will 
also  be  strictly  feasible.  Also  for  QP  and  LCP,  the  matrix  F'(x,y)  is  nonsingular  for  all 
( x,y )  >  0;  hence  Algorithm  1  is  well-defined. 

For  (x,t/)  E  T,  we  use  the  4-norm  of  the  residual  of  (1.1),  i.e., 

Il-f,(*,y)l|i  =  xTy, 

as  our  measure  of  convergence.  This  measure  can  be  shown  to  be  the  duality  gap  in 
linear  and  quadratic  programming. 

Observe  that  all  three  pairs  (Axk,  Ayk),  ( Ax?,Ay jf)  and  (Ax? ,  Ay?)  satisfy  the 
equation  Mu  +  Nv  =  0.  We  also  have  the  following  useful  relationships: 

YkAxk  +  XkA  yk  =  -XkYke  +  cr  k^xfyke  (2.1) 

and 

xk+iVk+i  =  xlvk(  1  -  (1  -  crk)ak)  -|-  Ax? A yka\.  (2.2) 

Algorithm  1  covers,  or  is  closely  related  to,  a  wide  range  of  existing  interior-point 
algorithms  for  linear  programming,  quadratic  programming  and  linear  complementarity 


5 


problems.  In  particular,  it  covers  most  of  the  existing  primal-dual  interior-point  al¬ 
gorithms  for  linear  programming  as  well  as  quadratic  programming,  including  Kojima, 
Mizuno  and  Yoshise  [8],  Todd  and  Ye  [13],  Monteiro  and  Adler  [11,  12],  Lustig  [9],  to 
name  a  few.  Algorithms  for  linear  complementarity  problems  that  are  covered  by  Al¬ 
gorithm  1  include  Kojima,  Mizuno  and  Yoshise  [6,  7],  Kojima,  Megiddo  and  Noma  [3], 
Kojima,  Megiddo  and  Ye  [4],  Kojima,  Mizuno  and  Noma  [5].  For  more  references,  see 
two  recent  review  papers  by  Ye  [14,  15].  Although  these  algorithms  have  been  motivated 
and  presented  in  various  ways  including  path- following  (homotopy  or  continuation),  po¬ 
tential  reduction  or  affine  scaling  algorithms,  most  of  them  fit  into  the  framework  of 
Algorithm  1. 

3  Choices  of  Parameters 

There  are  two  control  parameters  in  Algorithm  1.  One  is  the  so-called  centering  pa¬ 
rameter  <Jk  and  the  other  is  the  step-length  parameter  ak.  In  [17],  Zhang,  Tapia  and 
Potra  established  sufficient  conditions  for  choosing  the  two  parameters  for  Algorithm  1 
to  achieve  superlinear  convergence.  Our  concern  in  this  paper  is  both  global  and  local 
behavior  of  the  algorithm  appled  to  QP  and  LCP.  For  LP,  this  issue  has  been  studied  by 
Zhang  and  Tapia  [18].  They  gave  rules  for  choosing  the  centering  and  the  step-length  pa¬ 
rameters  so  that  both  polynomial  complexity  and  superlinear  convergence  are  obtained. 
In  this  section,  we  will  modify  their  rules  for  choosing  the  step-length  parameter  for  LP. 
The  modified  rules  will  fit  not  only  LP  but  also  QP  and  LCP. 

We  adopt  the  following  notation: 

xk(a)  =  xk  +  aAn,  yk(a)  =  yk  +  aAyk, 
fk(a )  =  Xk(a)Yk(a)e,  f%ve(a)  =  \xk(a)T  yk(a),  (3.1) 

=  min(/fc(o:)),  /Tax( a )  =  ma  x(/*(a)). 

Whenever  a  =  0,  we  will  drop  the  argument  from  the  above  functions.  For  example,  xk  = 
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Zfc(O),  fr  =  /r(0)  and  so  on.  Clearly,  we  also  have  xk+i  =  xk(ak ),  =  fkve(ak) 

and  so  on. 

It  is  important  not  to  allow  any  x\y\  to  become  too  small  compared  with  the  average 
value  \xj.yk  (see  [17],  for  example).  Hence  we  require  that  a  —  ak  satisfies 

>  7*,  a  >  0,  (3.2) 

/r(«)  - 

where 

Ik  €  b,/f7/n  and  0  <  1  <  <  1-  (3.3) 

Note  that  in  the  case  f™n/ /ove  >  7,  we  allow  7*  to  decrease  monotonically  as  long  as 
7 k  >  7- 

It  is  easy  to  verify  that 

Am  =  A-  (A  -  <^/r> + a^a^2.  (3.4) 

Hence,  f'k(a )  is  a  quadratic  for  every  i.  As  a  result,  /™n(a)  and  fk^x{a)  are  piecewise 
quadratics.  Moreover,  fkve(a)  is  also  a  quadratic  and 

/TH  =  /n  1  -  (1  -  (3.5) 

For  notational  convenience,  let  us  introduce  the  piecewise  quadratic  function 

m«)  =  yrn(o)  -  7»/r(«).  (3.6) 

It  follows  that  condition  (3.2)  is  equivalent  to 

hk(a )  >0,  a  >  0.  (3.7) 

In  determining  ak  we  will  use  the  following  quantity: 

ak  —  min{a  >  0  :  hk(cn)  =  0}.  (3.8) 

The  following  lemma  is  given  in  Zhang  and  Tapia  [18]. 
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Lemma  3.1  The  quantity  a 1  is  well  defined  and  a 1  G  (0,  dfc).  Moreover,  condition  (3.2) 
is  satisfied  for  all  a  G  (0,  a*]. 

An  equivalent  expression  for  a)  is 

al  =  min{a  >  0  :  flk(a)  -7 kf£ve(a)  =  0 ,  i  =  l,2,...,n}. 


The  computation  of  a f.  involves  calculating  the  roots  of  at  most  n  quadratics  and  therefore 
requires  0(n )  operations. 

In  addition  to  a  lower  bound  for  {fk(ak)/fkVe(c‘k)}  (i.e.,  condition  (3.2)),  we  also 
impose  an  upper  bound  on  these  quantities;  namely,  we  require  ak  to  satisfy 

/r» 


where 


rw  sr‘’  “>0, 

ue[/r“//r.r]  and  1  < /„“//r  <  r  <  n. 


(3.9) 


(3.10) 


Since  fl(ce)/ fkve(ce)  <  n  for  all  i,  condition  (3.9)  will  be  redundant  if  Tk  =  n.  Our  reason 
for  introducing  condition  (3.9)  is  to  improve  our  complexity  bound. 

Similarly,  we  introduce  the  piecewise  quadratic  function 


H„(a)  =  /r»  -  r*/r»- 


(3.11) 


It  is  easy  to  see  that  condition  (3.9)  is  equivalent  to 

Hk(a)  <0,  a  >  0. 


(3.12) 


4  =  < 


(3.13) 


We  define 

+00,  if  {a  >  0  :  Hk(a )  =  0}  =  0, 
min{a  >  0  :  Hk(a)  =  0},  otherwise. 

Analogous  to  Lemma  3.1  for  condition  (3.2),  we  have  the  following  lemma  for  condi¬ 
tion  (3.9). 


Lemma  3.2  The  quantity  is  well-defined  and  af.  G  (0,dfc).  Moreover,  condition  (3.9) 
is  satisfied  by  all  a  G  (0,a£)  and  also  by  a  =  when  the  latter  is  finite. 
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Proof:  The  proof  is  similar  to  that  for  Lemma  3.1,  so  we  omit  it.  □ 

Similarly,  can  be  found  by  calculating  the  roots  of  at  most  n  quadratics  and 
requires  0(n)  operations. 

The  duality  gap 

xk(a)Tyk(a)  =  xjyk  -  xjyk(  1  -  ak)a  +  Ax*  A yka2  (3.14) 


is  a  quadratic  function  of  a  with  the  second  derivative  AxJ.A yk.  If  AxjA yk  >  0,  it  will 
reach  its  minimum  at 

(1  -  < 7k)xTkyk 


olI  - 


tk  -  OA  Ta - •  (3.15) 

2AxlAyk 

If  AxkAyk  —  0,  the  duality  gap  is  a  decreasing  function  of  a;  so  it  is  always  desirable 
to  take  the  largest  step-length  possible.  For  LCP  and  QP,  one  always  has  AxjA yk  >  0 
(see  Lemma  3.3  below).  Therefore  our  choice  of  the  step-length  ak  is 


ak  =  < 


(3.16) 


min(l,  al,  o£,  a^),  if  AxlAyk  >  0, 
min(  1 ,  a~l ,  a\. ) ,  otherwise, 

where  aj.  is  defined  by  (3.8),  by  (3.13)  and  ak  by  (3.15).  This  choice  of  step-length 
will  guarantee  (3.2),  (3.9)  and  ak  €  (0,6:*;). 

For  the  sake  of  simplicity,  we  will  enforce  the  conditions 


7 k  <  1/2  and  T*  >  2. 


(3.17) 


The  specific  values  in  (3.17)  do  not  constitute  a  loss  of  generality  because  they  will  only 
affect  expressions  for  some  constants  in  our  analysis.  These  values  of  -fk  and  Vk  will  lead 
to  much  simplified  expressions  for  those  constants. 


Procedure  1 

Given 


0  <  7  <  min(l/2,/fn//D,  max(2,  fT/fT)  <T<n- 
Step  1  Choose  €  [7,  min(l/2,  ffn/fkve)]  and  €  [max(2,  /™ax/ fkye),  T]. 


(3.18) 
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Step  2  Compute  af  by  (3.8),  by  (3.13),  and  if  necessary,  of.  by  (3.15). 

Step  3  Compute  ak  by  (3.16). 

When  AxkAyk  =  0,  the  above  procedure  basically  reduces  to  Procedure  1  in  [18], 
which  was  designed  for  LP  where  AxfAyk  =  0. 

Now  we  shift  our  attention  to  the  choice  of  the  centering  parameter.  We  will  use 
exactly  the  same  strategy  to  choose  ak  as  that  used  in  [18].  However,  for  the  sake  of 
completeness  we  still  describe  the  choice  in  detail.  Let 

Pk  =  Axk  ,  Qk  =  Yk  Ayk  , 

P»  =  xp  ,«  =  n-'Arf.  (3.19) 

Pck  =  XpAxl  q°k  =  Yk'Ayck, 

and 

uk  =  max(|(rf)‘(,ni.  l(rfM)*l,  lOftWl,  l(rf)‘(tf  yi).  (3-20) 

l<i<n 

Lemma  3.3  For  QP  and  LCP, 

(i)  AxfAyk  >  0,  (Axf)T(A yf)  >  0  and  (Ax%)T(A yjf)  >  0; 

(ii)  ifffVfr  >  3,  then  u>k  <  n/72. 

Proof:  (i)  Since  all  three  pairs  (Ax*,  Ay*),  (Axj^,A yk)  and  (Ax^,A y^)  satisfy  the 
equation  Mu  +  Nv  =  0.  It  suffices  to  prove  that  uTv  >  0  for  all  G  Rn  satisfying 
Mu  +  Nv  —  0. 

In  the  case  of  LCP  (N  =  —I),  Mu  +  Nv  =  0  is  equivalent  to  v  =  Mu.  Hence 
uT v  =  utMu  >  0  because  M  is  positive  semi-definite. 

In  the  case  of  QP,  Mu  +  Nv  =  0  is  equivalent  to  Au  —  0  and  BQu  =  Bv  (see 
(1.3)).  Using  the  representations  u  =  BTU2  and  v  =  ATv  1  +  BTv 2,  where  v\  G  Rm 
and  u2,vi  G  Rn-m,  and  noticing  that  AT  X  BT ,  we  have  uTv  =  uTfBBTv2.  Moreover, 
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BQu  =  Bv  is  equivalent  to  BQBTii2  =  BBTv 2.  Hence,  if  Q  is  positive  semi-definite  on 
the  null  space  of  A,  then 

uTv  =  u^BBTV2  —  u^{BQBt)u2  >  0. 

(ii)  Multiply  both  sides  of  YkAx%  +  XkAyjf  =  —XkYke  by  ( XkYk)~ *  and  consider 
the  square  of  the  t^-norm  of  both  sides.  Using  (i)  of  Lemma  3.3,  we  have 

llPfcn)  W  +  ii(Jf4n)i«ff  < 

or  equivalently  after  dividing  both  sides  by  ^xfyk, 

K'bj'll2  +  lir;bni2  <  (3.21) 

where  Tk  =  ^xJy^XkYk)*1  is  a  diagonal  matrix.  Since  /™n//jtve  >  7,  it  is  easy  to  see 
that 

\(PkY\  <  \[nh  <  \fch  and  \(<lk)'\  <  y/nft  <  y/nh- 

Similarly,  we  can  prove 

l(P*)*l  <  Vnh  and  |(^)*|  <  y/n/j- 

The  result  in  (ii)  of  Lemma  3.3  follows  directly  from  the  definition  of  u>k  and  the  above 
estimates.  □ 

We  now  state  our  procedure  for  choosing  the  centering  parameter  <7^. 

Procedure  2 

Given 

<>•€(0,1),  =  .  (3.22) 

2n  n 

Step  1  Compute  Uk  from  (3.20). 

Step  2  Compute  pi  —  min(p“,  o/uk). 

Step  3  Choose  pk  €  [(pl  +  p£)/2,  p]!]. 
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Step  4  Let  crk  =  pk^k- 

It  is  easy  to  verify,  using  (ii)  of  Lemma  3.3,  that  pk  >  pl ;  thus  Uk  is  well-defined. 
Moreover,  we  have  Ok  <  Pkuk  <  a  <  1. 

Overall,  we  have  the  following  algorithm. 

Algorithm  2  Given  a  strictly  feasible  pair  (xo,yo).  Choose  (recall  (3.18)) 

0  <  7  <  fr/fr),  max(2,  <  r  <  n, 

and  cr  £  (0, 1).  Set  p1  —  and  pu  >  ry2 cr/n .  For  k  =  0, 1, 2, . . .,  do 

Step  1  Compute  (Axk  ,  Ay(f)  and  (Ax£,  A yk)  from  Algorithm  1. 

Step  2  Choose  (Tk  by  Procedure  2  and  form  (Ax*,  Ay*)  from  Algorithm  1. 

Step  3  Choose  ctk  by  Procedure  1. 

Step  4  Form  (xk+i,yk+ i)  from  Algorithm  1. 


4  Polynomiality 


In  this  section,  we  will  establish  the  global  behavior  of  Algorithm  2.  We  first  define 


6  =  ^AxfAyk  -  max(Axj.A?4) 

Vk  =  ^ AxfAyk  -  min(Ax^A^). 

Lemma  4.1  Let  df  be  given  by  (3.8).  If  gk  <  0,  then  df  >  1;  otherwise , 

7  ^  (!  “  lk)vkxlyk  (1  -  lk)*kfr 

at  >  - =  - . 

nrtk  Vk 

Proof:  First  we  notice  that  for  a  €  [0, 1], 


(4.1) 


(4.2) 


/»(«)  =fi-  (ft  -  +  A4A  vW  >JT-  iff"  -  n/r>  +  min(Axi &yl)a 
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Therefore, 


/!(«)  -  7 fc/r («)  >  /T  -  (/fn  -  ^/r)«  +  min(Ax>  Ayi)a2  -  7fc/jT(a) 

=  (/rn  -  7*/r)(l  -  a)  +  (1  -  7*)a*/rea  -  (4.3) 

>  (1  -  7 k)crkf%vea  -  VkOi2. 

If  Vk  <  0,  then  it  follows  that  hk(a)  has  no  root  in  (0, 1);  hence  cPk  >  1.  Otherwise,  the 
quadratic  in  the  right-hand  side  of  the  last  inequality  has  a  unique  positive  root 

(1  -  7 k)(Tkxlyk  (1  -  7 k)(Tkfkye 

a.  —  - = - . 

nr]k  T]k 

Therefore,  if  <  1,  from  (4.3)  oTk  must  be  greater  than  or  equal  to  the  above  positive 
number.  This  completes  the  proof.  □ 


Lemma  4.2  Let  a\  be  given  by  (3.13).  If  fk  >  0,  then  af.  >  1;  otherwise, 


r  ^  (!  “  r k)akXTkyk  (1  -  Tk)akftve 
aii - * - = - 6 - ' 

Proof:  The  proof  is  similar  to  that  of  Lemma  4.1.  So  we  omit  it. 


(4.4) 

□ 


Lemma  4.3  Let  £k  and  r]k  be  given  by  (f.l). 

(>)  &  >  -4 U)kfsr, 

(ii)  <  6 


Proof:  (i)  Note  that 


|A4Ay[|  =  \(xiyi)(Piqi)\ 

<  ma,x(XkYke)\\diag(pk)qk\\cx> 

=  fr*\\diag{pNk  +  <rkpcM  +  *kP°h)  II 

<  /f“wfc(l  +  o’*,)2 

<  4  /rw 
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Since  AxkAyk  >  0,  we  have  (see  (4.1)) 


6  >  -  max( Ax'kAy'k)  >  -4 f™xuk. 

(ii)  Since  |Ax^AyJ.|  <  4 fFAXuk,  AxkAyk  <  4 nf^Uk.  Therefore, 

Vk  =  ~ Ax*  Ay*  -  min(Ax‘fcAy£) 
n 

<  47fc/rx^ + 4/rx^ 

<  e/rx^, 


because  7*,  <  1/2.  This  completes  the  proof. 


□ 


Lemma  4.4  Let  ( xk,yk ),  {Axk,A yk)  and  (o/,o£)  be  generated  by  Algorithm  2.  Then 
there  exists  a  constant  f3  >  0,  such  that 


Moreover , 


min(l,o£,a£)  > 


*lVk  ~  47' 


(4.5) 


(4.6) 


Proof:  From  Lemmas  4.1  and  4.2,  it  suffices  to  consider  the  situation  where  £*  <  0  and 
rjk  >  0.  In  this  case, 


> 

min  ( 

(1 — tkWkfi 

Vk 

> 

min  ( 

(>■ 

0.5  <rfc/tave 

> 

min  ( 

>■ 

1217 

> 

min  | 

I1- 

72£..) 

24rn/ 

> 

(  &- 

)i 

[(3.17)  and  Lemma  4.3] 

L/T7/r  <  r  and  °k  =  PkWk] 

[pk  >  Pl  =  'y2*? /2n\ 

[7  <  1,  T  >  1  and  a  <  1]. 


Hence, 


will  satisfies  (4.5). 
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72(j 

24 F 


(4.7) 
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Now  define  Dk  =  XkYk  1  and  let 

rk  =  [ak^xTkyk(XkYk)-^2  -  (XkYk)^2}e. 

It  follows  that 

rlrk  =  xTkyk  ^1  -  2 ak  +  a2k\xlyk-  <  xkVk(^  ~  2 crk  +  <7/7),  (4.8) 

since  /£ve//£  <  I/'T* 

Multiplying  both  sides  of  (2.1)  by  (A^T*,)-1/2  gives 

rk  =  Dk1/2  Axk  +  DlJ2Ayk. 

Therefore, 

rkrk  =  AxlDk1Axk  +  Ay'[DkAyk  +  2AxlAyk 

=  \\Dkl/2Axk  -  Dj/2A?/i||2  +  AAxJ.Ayk  (4.9) 

>  4AxfA?/fc. 

Combining  (4.8)  and  (4.9)  and  noting  ak  <  1  leads  to 

<  |(l-2  n  + 

xk  yk 

=  KC1  “  Vk)2  +  <rk(^  -  1)) 

<  A- 

This  completes  the  proof.  □ 


Theorem  4.1 

Let  {(xfc,?/*;)}  be  generated  by  Algorithm,  2.  Then 

Xl*rw  <  (1  -  4)  <  1, 

xkVk 

where  6k  —  0(4). 


Proof:  From  (2.2), 


xk+1Tyk+1  =  xlyk 


1  -  (1  -  crk)ak  + 


Ax\Ay, 


*2 


xTkVk 


CCl 
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We  must  estimate  the  quantity 


6k 


^1  -  Ok  - 


AxjAyk 

xhk 


ak. 


(4.10) 


Since  6k  <  1  is  guaranteed  in  Algorithm  2  by  the  choice  of  ak,  it  is  sufficient  to  verify 
that  8k  —  fl(4). 

Consider  the  following  two  functions  of  a 


8k(a) 


-  fTfc  - 


AxjAyk 

T  a  ) 

xkVk  J 


a 


and 

8(a) 

From  (4.6)  and  crk  <  er,  for  a  >  0 


(4.11) 


(4.12) 


8k(a)  >  8(a). 


From  the  choice  of  ak  in  Procedure  1,  it  can  be  verified  that 

ak  =  argmax{4(a)  :  a  €  [0,  min(l,  a].,  a£)]}. 

Therefore,  for  all  a  €  [0,  min(l,  oPk,  a£)], 

8k  =  8k(ak)  >  8(a).  (4-13) 

Let  /?  be  defined  by  (4.7).  It  follows  from  (4.5)  that  (4.13)  is  satisfied  by  a  —  f3/n\ 

i.e., 

This  completes  the  proof.  □ 

The  following  corollary  follows  immediately  from  Theorem  4.1.  Its  proof  is  straight¬ 
forward  (see  [18]),  for  example).  By  a  standard  argument,  it  leads  to  polynomiality 
assuming  integral  data. 

Corollary  4.1  Assume  x^yo  <  2uL ,  where  L  >  0  and  v  >  0.  Then  in  at  most  0(nL) 
iterations,  Algorithm  2  will  produce  (xk,yk)  satisfying  xfyk  <  2~L. 
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5  Superlinear  Convergence 


In  this  section,  we  will  apply  the  following  superlinear  convergence  result  of  Zhang,  Tapia 
and  Potra  [17]  to  establish  (^-superlinear  convergence  of  Algorithm  2  for  QP  and  LCP. 

Theorem  5.1  (Zhang,  Tapia  and  Potra) 

Let  {(xfc,  t/jfc)}  be  generated  by  Algorithm  1  and  (x*,y*)  be  a  solution  of  problem  (1-1). 
Assume 

(i)  strict  complementarity  holds  at 

(ii)  {/fcVe//fctun}  is  bounded  above , 

(iii)  crk  — >  0  and  ak  — *  1. 

Then  if{(xk,  y^)}  converges  to  (z*,?/*),  the  sequence  {XkYkt),  component-wise,  converges 
to  zero  Q-superlinearly.  Moreover,  under  the  above  conditions,  atk  — >•  1  if  and  only  if 
Tfe  -»  1. 

Since  Tfc  is  directly  under  our  control  and  a k  is  not,  the  more  meaningful  result  is 
stated  in  terms  of  r*.  However,  Lemma  3.1  of  Zhang,  Tapia  and  Potra  [17]  demonstrates 
that  under  the  conditions  of  the  theorem,  6tk  as  defined  in  Step  3  of  Algorithm  1  converges 
to  1.  Hence,  ak  — +  1  if  and  only  if  r*  — »  1  and  we  may  consider  either  condition.  In  the 
sequel,  we  choose  to  verify  ak  — *  1. 

We  note  that  unlike  in  LP,  a  strictly  complementary  solution  may  not  exist  in  QP  or 
LCP.  So  the  strict  complementarity  assumption  for  QP  and  LCP  is  a  somewhat  strong, 
but  often  made,  assumption. 

For  the  same  technical  reasons  as  encountered  in  Zhang  and  Tapia  [18],  we  must 
restrict  further  the  choice  of  pk .  Denote  the  length  of  the  interval  \pl ,  pk]  by  7 r*.  It  follows 
from  (3.22),  Step  2  of  Procedure  2,  and  Lemma  3.3  that 

A  >  (5.1) 
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Thus, 


(5.2) 


,  7  2  a 

Let  Efc  be  the  following  set  of  2 n  points 

e*  =  {-(pfr/(pf)% -(<£)*!(<£ )'.  *• = i,  2,  - , »} 

and  define  the  distance  from  a  to  the  set  Efc  as 

dist(<r,  Sfc)  =  min{|<r  -  c|  :  C  €  E*}. 

We  choose  ak  according  to  Procedure  2  with  the  additional  restriction  that 

dist(<7fc,  E k)  >  KkUkl (8 n  +  4).  (5.3) 

In  other  words,  we  require  not  only 

ak  €  [0.5(/)/  +  pfcVfc,  (5.4) 

but  also  that  cr^  be  bounded  away  from  the  set  Efc  by  at  least  the  amount  7rfcu;fc/(8n  +  4). 
Since  {nk}  is  bounded  away  from  zero,  we  see  from  (5.3)  that  {dist(crfc,  S^)}  is  bounded 
away  from  zero  when  is  bounded  away  from  zero.  It  has  been  shown  in  Lemma  8.1 
of  Zhang  and  Tapia  [18]  that  the  set  of  a  values  satisfying  (5.3)  and  (5.4)  is  nonempty. 

Our  superlinear  convergence  theory  for  Algorithm  2,  applied  to  not  only  LP,  but  also 
to  QP  and  LCP,  is  the  following. 

Theorem  5.2 

Let  (a;*,y*)  be  a  solution  of  problem  (1-1)  and  {{xkiVk)}  be  generated  by  Algorithm  2 
with  the  restriction  (5.3)  on  the  centering  parameter  ak.  Assume 

(i)  strict  complementarity  holds  at  (xt,y*), 

(ii)  pu  is  sufficiently  large,  e.g.,  pu  >  24T. 
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For  LP,  QP  and  LCP,  if  {{xk,yk)}  converges  to  (x*,yt),  then  the  sequence  {XkYke}, 
component-wise,  converges  to  zero  Q-superlinearly. 

Proof:  Theorem  5.2  is  a  generalization  of  Theorem  8.1  in  [18],  i.e.,  the  superlinear 
convergence  of  Algorithm  2  applied  to  LP.  As  for  the  proof  of  Theorem  8.1  in  [18],  we 
need  to  show  ak  — ►  0  and  a*,  — *•  1. 

The  proof  for  ak  — ►  0  is  identical  to  that  in  [18],  because  it  only  requires  that  {a*,} 
be  bounded  below  and  that  {p%},  {qjf},  {pk}  and  be  bounded  above,  which  are 

also  true  for  QP  and  LCP  (see  Lemmas  3.3  and  4.4). 

The  proof  for  ak  — >  1  is  similar  to  that  in  [18].  First,  the  same  argument  used  in  [18] 
gives 

ak  <  oik  -*  1.  (5.5) 

When  AxfAyk  =  0,  it  follows  from  (3.16)  and  the  proof  of  Lemma  4.4  that 

a*  =  min(l,a2,aj)  >  min(l,^)  .  (5.6) 

From  the  definition  of  pk  and  the  fact  u>k  0,  for  k  sufficiently  large 

Pk  =  \(p'  +  pX)  >  \pX  =  \ p'- 

Therefore,  if  pu  >  24 F,  then  from  (5.6) 

at  >  1.  (5.7) 

Now  inequalities  (5.5)  and  (5.7)  together  imply  ak  — >  1. 

When  AxfAyk  >  0,  in  order  to  prove  (5.7)  we  also  need  to  show  that  otk>  1  for 
k  sufficiently  large  (see  (3.16)).  It  follows  from  Ax\Ayk  <  inuk /™ax  (see  the  proof  of 
Lemma  4.3  (ii)),  f  / fkve  <  T,  ak  <  a  and  uk  — >  0  that  as  k  — ►  oo 

„  =  (i  - *k)xTkyk  >  (i - *k)fr  >  i-o-  , 

afc  2AxjAyk  _  8<jjkfp*x  8Tuk 

Hence,  ak  =  min(l,  ak, a£,  af.)  >  1  for  k  sufficiently  large.  This  completes  the  proof.  □ 
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6  Concluding  Remarks 


In  this  paper,  we  have  constructed  a  primal-dual  interior-point  method  for  a  general 
problem  which  includes  linear  programming,  quadratic  programming  and  linear  comple¬ 
mentarity  problems,  and  have  demonstrated  its  0(nL)-iteration  polynomial  complexity 
and  its  Q-superlinear  convergence.  We  accomplished  the  above  objectives  by  adopting 
the  rules  for  choosing  step-length  in  the  Zhang- Tapia  polynomial  and  superlinearly  con¬ 
vergent  algorithm  for  LP  [18]  to  our  general  problem,  and  then  extending  their  theory 
to  our  problem. 
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